On-board vehicle query system

ABSTRACT

Generally described, the present disclosure relates to the efficient management and compact presentation of data or content with respect to a vehicle. For example, an operator of a vehicle may desire content related to vehicle operation, including, among many other forms of data, user manual information, warranty information, parts data, maintenance logs, etc. The disclosed techniques can use query inputs to optimize data presentation and provide augmented data to a user via an interactive user interface.

TECHNICAL FIELD

The systems and methods disclosed herein are directed to vehicle userinterfaces, and, more particularly, to an interactive user interfacethat provides query access for vehicle control and operationalinformation.

BACKGROUND

Vehicles, such as cars, boats, tractors, and planes, include a widevariety of control mechanisms designed for an operator to control andoperate a vehicle. For example, an operator of the vehicle canmanipulate the internal air temperature or radio volume of a car throughan interface, oftentimes located within reach of the operator orpassenger for easy access. The operator or passenger may also manipulatethe positioning of seats, external and internal lighting, windshieldwipers, or engine gears, usually through manual operation of therelevant control mechanism. In addition, the vehicle operator maymaintain or troubleshoot vehicle system health periodically throughoutthe lifetime of the vehicle. In doing so, the vehicle operator mayconsult a variety of material, such as a user manual or other materialrelated to the vehicle operation and maintenance.

SUMMARY

The systems and methods for the interactive controls and query accesstechniques disclosed herein have several features, no single one ofwhich is solely responsible for its desirable attributes. Withoutlimiting the scope as expressed by the claims that follow, certainfeatures of the user interface system will now be discussed briefly. Oneskilled in the art will understand how the features of the disclosedtechnology provide several advantages over traditional systems andmethods.

One embodiment relates to a system for accessing content for a vehicle,the system comprising a database storing vehicle operational contentformatted as a plurality of segmented portions each associated with aset of contextual metadata, a computer-readable memory storingexecutable instructions, and a processor in communication with thecomputer-readable memory and programmed by the executable instructionsto at least receive data representing a query spoken by a user, performnatural language processing on the data representing the query,determine that the query includes a request for a portion of the vehicleoperational content based at least in part on a result of the naturallanguage processing, identify a particular segmented portion of theplurality of segmented portions based at least in part on the set ofcontextual metadata of the particular segmented portion and the resultof the natural language processing, generate a user interface forpresenting the particular segmented portion on a display associated withthe vehicle, determine a driving status of one or both of the vehicleand the user, and when the driving status indicates that it is safe forthe user to view information on the display, cause output of the userinterface on the display, or when the driving status indicates that itis not safe for the user to view information on the display, store datarepresenting the user interface for later output on the display.

In one aspect, the processor is further configured to store a version ofthe particular segmented portion corresponding to a version of a usermanual of the vehicle that is available at a time of storing theversion, receive, over at least one network, an update to the particularsegmented portion, and generate the user interface to reflect the updateto the particular segmented portion.

In yet another aspect, the processor is further configured to determinethe driving status is in motion in response to determining that thevehicle is in motion above a predetermined threshold, and wherein thein-motion driving status indicates that it is not safe for the user toview information on the display.

In another aspect, the processor is further configured to determinewhether the query originates from an operator of the vehicle, and inresponse to determining the query originates from the operator, causeoutput of an audible reading of the particular segmented portion througha speaker.

In yet another aspect, the display is in a field of view of an operatorof the vehicle.

In another aspect, the processor is further configured to determine aset of vehicle controls relevant to the query, and generate the userinterface to include navigational links to the vehicle controls.

In yet another aspect, the processor is further configured to generatethe user interface to include an animation of instructions included withthe set of vehicle controls to animate the relevant set of vehiclecontrols.

In another aspect, the processor is further configured to receivecontextual content from at least one remote data source to augment theparticular segmented portion; and present the contextual content as partof the user interface.

Another embodiment relates to a computer-implemented method, comprisingreceiving data representing a query spoken by a user, performing naturallanguage processing on the data representing the query, determining thatthe query includes a request for a portion of the vehicle operationalcontent based at least in part on a result of the natural languageprocessing, identifying a particular segmented portion of the pluralityof segmented portions based at least in part on the set of contextualmetadata of the particular segmented portion and the result of thenatural language processing, generating a user interface for presentingthe particular segmented portion on a display associated with thevehicle, determining a driving status of one or both of the vehicle andthe user, and when the driving status indicates that it is safe for theuser to view information on the display, cause output of the userinterface on the display, or when the driving status indicates that itis not safe for the user to view information on the display, store datarepresenting the user interface for later output on the display.

One aspect further comprises storing a version of the particularsegmented portion corresponding to a version of a user manual of thevehicle that is available at a time of storing the version, receiving,over at least one network, an update to the particular segmentedportion, and generating the user interface to reflect the update to theparticular segmented portion.

Another aspect further comprises determining that the driving status isin motion in response to determining that the vehicle is in motion abovea predetermined threshold, wherein the in-motion driving statusindicates that it is not safe for the user to view information on the.

Yet another aspect further comprises determining whether the queryoriginates from an operator of the vehicle, and in response todetermining the query originates from the operator, causing output of anaudible reading of the particular segmented portion through a speaker.

In one aspect the display is in a field of view of an operator of thevehicle.

Yet another aspect further comprises determining a set of vehiclecontrols relevant to the query, and generating the user interface toinclude navigational links to the vehicle controls.

Another aspect further comprises generating the user interface toinclude an animation of instructions included with the set of vehiclecontrols to animate the relevant set of vehicle controls.

Yet another aspect further comprises receiving contextual content fromat least one remote data source to augment the particular segmentedportion, and presenting the contextual content as part of the userinterface.

Yet another embodiment relates to a non-transitory, computer-readablemedium having stored thereon computer-executable software instructionsconfigured to cause a processor of a computing device to performoperations comprising receiving data representing a query spoken by auser, performing natural language processing on the data representingthe query, determining that the query includes a request for a portionof the vehicle operational content based at least in part on a result ofthe natural language processing, identifying a particular segmentedportion of the plurality of segmented portions based at least in part onthe set of contextual metadata of the particular segmented portion andthe result of the natural language processing, generating a userinterface for presenting the particular segmented portion on a displayassociated with the vehicle, determining a driving status of one or bothof the vehicle and the user, and when the driving status indicates thatit is safe for the user to view information on the display, cause outputof the user interface on the display, or when the driving statusindicates that it is not safe for the user to view information on thedisplay, store data representing the user interface for later output onthe display.

In one aspect, determining the driving status of the user comprisesdetermining an origination point for the query.

In another aspect, the vehicle content comprises a plurality ofinteractive content segments, including the first segmented portion, andwherein the plurality of interactive content segments comprisesdiscretely packaged information.

In yet another aspect the operations further comprise receivingcontextual content from at least one remote data source to augment theparticular segmented portion; and presenting the contextual content aspart of the user interface.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 depicts a schematic diagram of a networked connected vehiclecommunication environment in which various embodiments according to thepresent disclosure can be implemented.

FIG. 2 depicts example systems, components, and applications of theconnected vehicle of FIG. 1 in a sample network environment.

FIG. 3A depicts an example cabin of a vehicle, such as the connectedvehicle of FIG. 1.

FIGS. 3B-3F illustrates a sample user interface that may be implementedin conjunction with the connected vehicle of FIG. 1 or 2, according tovarious embodiments of the present disclosure.

FIG. 4 illustrates a flowchart for receiving and utilizing a user queryin a connected vehicle having user interfaces, such as those describedwith respect to FIGS. 3B-3D.

FIG. 5 illustrates a computer system with which certain methodsdiscussed herein may be implemented.

DETAILED DESCRIPTION

Generally described, the present disclosure relates to an artificialintelligence (AI) engine for processing queries and dynamicallydetermining when and how to display resulting content, for example toavoid distracting a driver. A connected vehicle can have many controls,parts, customization tools, or other features that a user can leveragein order to fully utilize the vehicle to its full potential. However,most of these features remain underutilized or unknown to a user due tothe large number of features available and the lack of accessibility toinformation regarding these features to a user. As such, it becomesdifficult for a user of a vehicle to quickly learn and understand howbest to utilize all the different features of a connected vehicle or howto access this information quickly in real time or near time when theinformation is desired. In addition, the user may require additionalinformation than is available in a standard user manual, or the usermanual that comes with the vehicle may be out dated by the time the userrequires the relevant information. In most instances, when encounteringa problem with the vehicle or when requiring prompt assistance forcustomizing or changing operation of the vehicle, a user of a vehicle(e.g., an operator, driver, passenger, owner, etc.) may require theinformation immediately upon identifying the need. However, the user maybe not be able to access the information while operating the vehicle andmay not be able to synthesize the information quickly enough, such thatthe user may take action based on the information in the short timenecessary. Further, a user could endanger themselves or a vehicularsystem, such as the engine control system, by not understanding thesystems within the vehicle or knowing how to quickly access informationin a manner that is not distracting to the user. Further, any staticinformation obtained through a standard user manual, for example, maynot necessarily relate to the user's specific problem based on thecontext in which the problem arose.

The aforementioned problems, among others, are addressed in someembodiments by the disclosed AI engine for providing access to contentin response to a user query. Specifically, the AI engine can usesemantic search techniques and contextual metadata to provide a highlyaccurate method for querying the content within the on-board user guide,installed in the vehicle's storage device. Some embodiments can augmentthe accessed user guide content with relevant external content (e.g.,from data sources outside the vehicle) based on the context of the userquery, to provide a higher degree of relevance to the response. Theamount and type of information displayed can depend on whether thevehicle is moving or not, whether the vehicle is being autonomouslydriven, and which passenger is making the query. The AI engine canmanage provision of query results in a way that can be minimallydistracting to an active driver. For example, if a user is driving, theAI engine may respond and say that it will provide the information tothe driver at a later time (e.g., when the car is parked).

Certain types of information related to vehicle operation (“vehiclecontent information”) may be stored on-board a vehicle in a memorystorage device. In some embodiments, some or all of this information maybe stored on a data server accessible from the vehicle through a datanetwork (i.e., wired or wireless). The vehicle content information maycontain all vehicle system related information, including documentation,warranty information, user guides, emergency or maintenance contactinformation, maintenance logs, vehicle performance data, GlobalPositioning System (GPS) logs, diagnostic details, vehicle customizationdetails, etc.

The vehicle content information may be segmented and configured foroptimal presentation on a display device, such that the segments maycollectively represent a significant portion of the vehicle system'savailable content. As used herein, a content segment generally refers toa discrete portion of information (e.g., portions of information thatare topically related) packaged in a standalone form. A content segmentcan include, for example, one or more of textual information, graphicalinformation, videos, and audio content. A content segment may be aninteractive design pattern, such as a card component or formattedgraphical unit. In some instances, a content segment may be configuredto be displayed on a display device without requiring a user tomanipulate the segment in order to fully access the entirety of thediscrete portion. In other instances, a content segment may require somemanipulation of the segment itself in order to fully access the entirediscrete portion (e.g., a gesture control, scrolling, etc.). Inaddition, a content segment may be responsive to user interaction. Forexample, selecting aspects of a content segment may cause more data tobe shown. In a non-limiting example, the entire content segment may beprogrammed to be selectable, as well as individual aspects of thecontent segment, such that selecting certain portions of a contentsegment may cause the occurrence of one response, whereas selectinganother portion of the content segment may cause a different response.The content segments may be bound together in a contextual relationship,for example, by coding each content segment with context-rich metadata.In some embodiments, a link may be included to additional informationstored in other memory storage devices (e.g., how-to-videos, weatherforecasts, etc.). Additionally, embedded links may be included within acontent segment that when activated, call another application. Forexample, selection of an embedded link may cause the presentation of anelectronic control interface that allows a user to control a feature ofthe vehicle via the electronic control interface (e.g., activatingwindow controls, climate controls, etc.).

A user may provide a query through use of a search keyword entered intoa search field or as an audible query using a microphone. For example,the microphone of the vehicle may be initiated by a touch input orbutton, or may be configured to monitor for voice commands duringcertain conditions (e.g., when a passenger is sensed in the vehicle,when the vehicle is on or driving). Initiation of the microphone oranother query input device may activate the query system. Onceactivated, the query system may receive a query from a user. A user maydeactivate or cancel the query system. An icon or animation may bedisplayed indicating that the query system is activated and in listeningmode or otherwise in thinking mode when processing a query.

Upon processing the query, relevant content segments may be identifiedfrom various sources. The relevant content segments may be identifiedbased on semantic search techniques and the context-rich metadataassociated with each segment. In some embodiments, the relevant contentsegments may be augmented by the query system. For example, the querysystem may be able to perform compound or hybrid searches using sourcesof content stored outside of the vehicle (e.g., a cloud network, utilitycompany information, government and state agencies (e.g., environmentalprotection agency), etc.) to provide a higher degree of relevance andcomplexity to the response. For example, the additional content and/ordata may be obtained via an API call to a content server or database orobtained directly from the vehicle (e.g., a vehicle sensor). The contentsegments may be prioritized based on, for example, degree of relevancy,and arranged for presentation on a user display (e.g., mobile device,vehicle display device, etc.).

The results of the query, including the relevant content segments and/orthe augmented content, may be arranged to fit on a screen and presentedon the display screen. For example, the size of a target display screenmay be determined and the relevant content segments selected andarranged based on the total available size of the screen. Alternatively,a portion of the content may be displayed on the screen while otherinformation may be conveyed audibly. In some embodiments, a user may beable to scroll up or down on the screen such that the size of the screendoes not restrain the amount of information that may be presented fordisplay.

The amount and type of information displayed can depend on the status ofa vehicle or whether the query is determined to be coming from anoperator (e.g., driver, pilot, captain, etc.), rather than a passenger,of the vehicle. For example, if the vehicle is in motion at speedsgreater than a predetermined threshold speed and a query is receivedfrom a system associated with an operator of the vehicle, the querysystem may suppress the visual display of information on the displaydevice associated with the operator or delay the visual display untilthe speed decreases. Additionally, if the vehicle is in motion the querysystem may provide the results of the query as an audible output througha speaker system, or may indicate that the system will provide therequested information at a later time (e.g., when the car is parked, istraveling at a low enough speed or accelerating/decelerating at an lowenough rate). In some embodiments, the system may able to differentiatebetween an operator and a passenger based on where initiation orsubmission of the query originates within the vehicle. For example, aquery may be initiated based on the pressing of a button located on thevehicle's steering wheel. Because the query is initiated from thesteering wheel, the system may determine that an operator is making thequery. The system may determine that the results of the query should bedisplayed on a display device located in proximity to the operator(e.g., within the visible field of view of the operator) or on a displayotherwise known to the system as being associated with the operator(e.g., the operator's mobile device). In some instances, specificdisplay devices within a vehicle may be flagged as being associated withan operator, whereas others may be flagged as being associated with apassenger. For example, a display device located on the passenger doorpanel may be preprogrammed as a display device associated with apassenger because in normal operational use, the display would be usedby a passenger. Additionally, each display device or each vehiclecompartment may have dedicated query activation capabilities, such thatactivation from each device would register as a query associated withthe originating device. In some embodiments, the query system maydisplay results on a display device associated with a passenger of thevehicle or on a mobile device of the passenger. In some instances, amobile device may be docked in a vehicle in which case the displayedcontent may be on the mobile device until the mobile device is undockedfrom the vehicle or may remain presented on the mobile deviceindefinitely. In addition, results of a query may be presenteddifferently depending on the specific display device targeted fordisplay. For example, the system may determine that the results areslated for display in a rear-display (e.g., associated with a passenger)and as such, may present additional content that would otherwise, beomitted from display for an operator (e.g., a video or other mediastreaming that may be distracting to an operator but perfectly safe fora passenger display).

In some embodiments, the query system may determine, through semanticprocessing, that the query includes a request for an action (e.g., “howdo I adjust the position of my seat?”), rather than a request solely forinformation (e.g., “where do I adjust the position of my seat?”). Thequery system may determine the relevant content segments from theinternal or external databases, but may also identify the relevantcontrols for implementing the action requested (e.g., seat adjustmentcontrols). The query system may present the relevant controls in a userinterface by themselves or in conjunction with the content segmentsdetermined to describe the process for implementing the action. In someembodiments, an animation may also be provided for such queries guidinga user on how to implement the action. In a non-limiting example, anindicator (e.g., light, series of lights, arrows, haptic feedback,sounds, etc.) may be activated guiding the user to the relevant controlswith audible instructions on how to understand such indicators. Thisinformation may be stored in connection with the control system, thequery system, or both as a linked data structure.

As would be appreciated by one of skill in the art, the dynamic displayof vehicle information content responsive to user queries, as disclosedherein, represents a significant technological advance over priorimplementations. Specifically, the disclosed techniques can identify anddisplay a limited set of vehicle-related content segments and augmentedcontent, resulting in an increased efficiency in accessing the relevantcontent quickly and allowing user interactions with multiple contentsegments. Further, the disclosed techniques can yield safety benefits bydynamically determining how and when to display query results, forexample allowing the user to choose to interact with the content segmentat a point in time when the query system deems safe. A user may also bepresented with the relevant vehicle control mechanisms based on theirquery, along with the related content segment describing those controlsbased on, for example, an embedded link between the content segment andrelevant controls. As such, the embodiments described herein representsignificant improvements in this computer-related technology.

Additional embodiments disclosed herein also represent improvements incomputer-related technology. For example, the vehicle system may receiveover-the-air (OTA) updates to keep content stored in the vehiclecurrent. In addition, content may be queried using a digital assistantand the results of the query may be displayed in a user-friendlyinteractive user interface and/or read aloud to avoid distracting adriver. Additionally, the vehicle system applications employed hereinmay, in some embodiments, be native to other software applications, andthus, the content segments may be displayed using similar UI/UXelements. Other example improvements include the ability to callexternal sources of information to provide a greater relevance andcomplexity to a response and in some embodiments, the ability to callAPIs (e.g., language translation APIs) to perform additional work withinthe system.

The ideas disclosed herein exist within the realm of computer-relatedtechnology. For example, the display of information in an interactiveuser interface where the relevant data does not necessarily reside in astorage device locally coupled to the relevant display device would bevirtually impossible to replicate outside the realm of computer-relatedtechnology. In a non-limiting example, the multi-faceted information(e.g., static content segments, dynamically augmented content segments,etc.) are simultaneously or dynamically obtained from disparate systems,identified by metadata in some instances, and simultaneously ordynamically presented in an interactive user interface. Thismulti-faceted information is presented in response to a user query,where a user may seamlessly navigate to additional content via theinteractive user interface. Additionally, the vehicle system mayintuitively present the data on the proper display, through the propermedium, and/or at the proper moment.

Additionally, it has been noted that design of computer user interfaces“that are useable and easily learned by humans is a non-trivial problemfor software developers.” (Dillon, A. (2003) User Interface Design.MacMillan Encyclopedia of Cognitive Science, Vol. 4, London: MacMillan,453-458). The various embodiments of interactive and dynamic userinterfaces of the present disclosure are the result of significantresearch, development, improvement, iteration, and testing and in someembodiments, provide a particular manner of summarizing and presentinginformation in electronic devices. This non-trivial development hasresulted in the user interfaces described herein which may providesignificant cognitive and ergonomic efficiencies and advantages overprevious systems. The interactive and dynamic user interfaces includeimproved human-computer interactions that may provide reduced mentalworkloads, improved decision-making, reduced work stress, and/or thelike, for a user. For example, user interaction with the interactiveuser interfaces described herein may provide an optimized presentationof vehicle-specific information from various sources and may enable auser to more quickly access, navigate, assess, and utilize suchinformation than with previous systems which can be slow, complex and/ordifficult to learn, particularly to novice users. For example, userswould face the problem of having to search through a user manual inorder to receive useful data for optimally using the vehicle and thenaccess a separate system to receive related content, all costing timeand valuable processing resources due to the extensive amount of timerequired. In addition, the content segments would not be presented in auser interface tied to relevant controls or other related contentsegments. Presentation of concise and compact information on aparticular user interface associated with the querying party makes forefficient use of the information available and optimal use of thevehicle having current information available from any number of datasources.

In addition, the task of navigating a large catalog of vehicleinformation (e.g., a user manual, a parts list, a warranty packet, etc.)or other item information database to locate relevant content can beburdensome and time consuming for users, especially if the users do notknow precisely what content they are searching for (e.g., not knowingthe name of a particular part or how to describe a sound made by avehicle). Typically, the user can locate a relevant page by manuallyflipping through a physical vehicle manual, or by navigating a browsestructure or table of contents of an electronic vehicle manual in whichthe items are arranged by category and subcategory. Typically, however,the table of contents includes several levels of categories, requiringthe user to navigate through several levels or category pages to arriveat the subcategory of interest. Further, in many cases, the items ofinterest are not accurately or intuitively categorized, requiring theuser to perform additional navigation or keyword searching. Thus, theuser frequently has to perform numerous navigational steps to arrive atthe catalog page or “item detail page” of interest.

In accordance with the present disclosure, users are allowed to moreeasily see, access and/or specify the most relevant data with respect tovehicle information. Further, the interactive and dynamic userinterfaces described herein are enabled by innovations in efficientinteractions between the user interfaces and underlying systems andcomponents. For example, disclosed herein are improved methods ofreceiving user inputs, extracting useful information from the userinput, correlating such information across various different datastructures, delivering the information to various system components,automatic and dynamic execution of complex processes in response to theinput delivery, automatic interaction among various components andprocesses of the system, and automatic and dynamic updating of the userinterfaces. The interactions and presentation of data via theinteractive user interfaces described herein may accordingly providecognitive and ergonomic efficiencies and advantages over previoussystems.

Various aspects of the disclosure will now be described with regard tocertain examples and embodiments, which are intended to illustrate butnot limit the disclosure. Although the examples and embodimentsdescribed herein will focus, for the purpose of illustration, specificcalculations and algorithms, one of skill in the art will appreciate theexamples are illustrate only, and are not intended to be limiting. Forexample, although described in the context of a connected vehicle, thedisclosed data transfer optimization techniques can be implemented inother mobile networked computing environments.

Overview of Example Networked Connected Vehicle and Environment

FIG. 1 depicts a schematic diagram of a networked connected vehiclecommunication environment 100 in which various embodiments according tothe present disclosure can be implemented. FIG. 1 depicts a connectedvehicle 120, which may be a car (as illustrated) or a truck, van, aerialvehicle, boat, train, or other motive vehicle. The vehicle 120 may be anelectric vehicle in some implementations, or may be a hybrid vehicle,hydrogen vehicle, or combustion vehicle.

The vehicle 120 can be configured to establish a number of differenttypes of wireless network connections, including satellite connectionsand WiFi connections. For example, the vehicle 120 can be equipped toconnect to geosynchronous satellites 105A, low-earth orbit satellites105B, global navigation satellite systems 105C, cellular base stationtransceivers 160 (e.g., for 3G, 4G, LTE, and/or 5G cellular networkaccess), and WiFi access points 125, as they are available. In turn, thegeosynchronous satellites 105A and low-earth orbit satellites 105B cancommunicate with gateways 110A, 110B that provide access to the network130. The cellular base station transceivers 160 can have connectionsthat provide access to the network 130. The global navigation satellitesystems 105C can communicate directly with the vehicle 120, for exampleto triangulate (or otherwise compute) its location. These varioussatellite, cellular, and WiFi network connections can be managed bydifferent third-party entities, referred to herein as “carriers.”

The vehicle 120 can use these various connections to communicate overnetwork 130 with remote computing resources such as the vehicletelematics servers 140 and infotainment servers 150. The network 130 caninclude any appropriate network, including a private network, personalarea network, an intranet, local area network, wide area network, cablenetwork, satellite network, cellular network, peer-to-peer network,cloud network, etc. or a combination thereof, some or all of which mayor may not have access to and/or from the Internet. The data network maybe implemented by data servers. In some embodiments, data servers may beimplemented on one or more host devices, such as blade servers, midrangecomputing devices, mainframe computers, desktop computers, or any othercomputing device configured to provide computing services and resources.In the illustrated embodiment, the network 130 is the Internet.Protocols and components for communicating via the Internet or any ofthe other aforementioned types of communication networks are known tothose skilled in the art of computer communications and thus, need notbe described in more detail herein.

The vehicle telematics servers 140 can store and analyze vehicletelematics data 145, for example diagnostic data received from thevehicle 120 and other vehicles. In some implementations, the vehicletelematics servers 140 can be maintained and securely stored by theentity that monitors vehicles for diagnostic, troubleshooting, andmaintenance purposes. Beneficially, analysis of the vehicle telematicsdata 145 can enable this entity to provide improved vehicle service,vehicle software and/or firmware upgrades, and aid in further contentdisplay. Accordingly, this entity can desire for certain telematics datato be provided from the vehicle 120 to the vehicle telematics servers140, perform telematics analysis on the data, and relay results fromthat analysis back to the vehicle for integrating the data with otherdisplayed content.

The infotainment servers 150 can store infotainment content 155, forexample media that provides a combination of information andentertainment. This media can include, for example, music, movies,podcasts, news, and other broadcast material that may be of interest tovehicle users. This content can be provided on demand to users of thevehicle 120. This data may be provided at predefined intervals (e.g.,sending predicted interesting news articles), or may be delivered inreal-time (e.g., on demand as requested by a user). In someimplementations, data stored on one or more of these servers may be usedto augment the requested on-demand data, supplement the data, replace ormodify the data stored in a storage device internal to the vehicle, orotherwise be displayed on a vehicle display device in connection with acontent query as further discussed below.

FIG. 2 depicts a block diagram of example system and applicationcomponents of the connected vehicle 120. In the illustrated embodiment,the vehicle command center 210 may reside in a central storage unit ofthe vehicle with a processing unit and computing components (e.g., modemunits) that enable the vehicle 120 to connect to the network 130, forexample via the satellites 105A, 105B and/or WiFi access point 125 ofFIG. 1. In addition, the command center 210 may include a number ofsystem applications 216, a query system 220, a vehicle manager 222,control system 224, display system 226, and content management system226. For example, system applications 216 can include user applications,vehicle applications, infotainment applications, such as mediastreaming, real time traffic visualization, network browsing, etc.

In some embodiments, content management system 218 manages, stores andprovides access to content stored on-board the vehicle or throughnetwork 130 from an external content database 230. The content stored ineither case may be embedded with context-rich metadata. For example, thecontext-rich metadata may be expressed in plain text, Hypertext MarkupLanguage (HTML), XML, Resource Description Framework (RDF), or any otherform as will be understood by the skilled person. In some embodiments,context-rich metadata comprises metadata that incorporates a multitudeof different ways to invoke a particular content segment and is includedin the content segment as part of its structured data. Accordingly,context-rich metadata comprises data elements (e.g., tags, links,keywords, fuzzy keywords, dynamically generated elements, context,etc.), that are configured to identify, alone or in combination withother elements, a content segment to display, for example, based on thepossible interactions that an end user may have with the vehicle system.In some embodiments, the data elements may be weighted or scored, wherethe weight for an individual metadata element may be dynamically updatedbased on a user interaction (e.g., using a ML model), so that themetadata may take on a texturized form. The content may includeinformation specific to the vehicle as described above and may bepartitioned into individual content segments that may be calledindividually based on a query. In some embodiments, only a portion ofthe total content may be formatted as content segments. For example,only the content that is frequently queried over time may be formed as acontent segment, such that not all vehicle information relevant to thevehicle need be segmented. The format of each content segment mayinclude a size and shape for the content, such that the format isaesthetically pleasing and available to a user when viewing the contentsegment on a display device, such as those content segments shown as anexample in FIG. 3D. Furthermore, each content segment may include itsown context-rich metadata that represents the segment itself and mayalso include links to other relevant content segments that, depending onthe contents and context of a query, may also be identified for displayon the display device in addition to presenting the primary contentsegment, as in FIG. 3D.

In some embodiments, a database included with a vehicle or external tothe vehicle may be or include a key-value data store, such as anobject-based database or dictionary. In a non-limiting example, adatabase may include any data structure (and/or combinations of multipledata structures) for storing and/or organizing data, including, but notlimited to, relational databases (e.g., Oracle databases, MySQLdatabases, etc.), non-relational databases (e.g., NoSQL databases,etc.), in-memory databases, spreadsheets, as comma separated values(CSV) files, extensible markup language (XML) files, TeXT (TXT) files,flat files, spreadsheet files, and/or any other widely used orproprietary format for data storage. For example, the content segmentsmay be laid out as individual, structured XML segments. Databases aretypically stored in one or more data stores. Accordingly, each databasereferred to herein (e.g., in the description herein and/or the figuresof the present application) is to be understood as being stored in oneor more data stores. In various embodiments, outgoing requests and/orincoming responses may be communicated in any suitable formats. Forexample, XML, JSON, and/or any other suitable formats may be used forAPI requests and responses or otherwise. As described herein, datatransfer refers to both transmitting data from a connected vehicle overa network and receiving data at the connected vehicle over a network.The data may be in various formats, such as a database format, files,XML, HTML, RDF, JSON, a file format that is proprietary to the system,data object format, or any other format, and may be encrypted or havedata of any available type.

In some embodiments, content management system 218 may receive contentfrom network 130 with instructions to replace or modify content storedwithin the vehicle. For example, a content segment may need to bereplaced with a new content segment or tagged with new metadata asinstructed from the network. The content managed by content managementsystem 218 may be accessed via query system 220 or through anintermediary such as vehicle manager 222. The content management system218 may also include links within individual content segments that routeto other content segments when selected or links to relevant controlmechanisms that may be presented as part of display system 226 uponrequest from a user or automatically based on the content or context ofthe query.

In some embodiments, the query system 220 is an AI engine capable ofreceiving and processing a query, and determining how to deliver theresults, in accordance with certain embodiments described herein. Forexample, a user of the vehicle (e.g., operator, passenger) may press abutton located within the vehicle (e.g., on the steering wheel,dashboard, etc.), select and hold the button for the full or partialduration of the query, enter a keystroke, select a soft key on a touchenabled display that is wired to the vehicle or otherwise wirelesslyconnected to the vehicle, and/or provide a preconfigured voiceinitialization command, to signal to the vehicle that the user desiresto initiate the query system 220. In some embodiments, query system 220may also identify and track from whence the query command originates(e.g., a physical section of the vehicle associated with the operator, apassenger section). The query system 220 may also recognize throughfacial or voice recognition, and thereby track, which user of thevehicle submitted a query. A history of queries may be stored in memoryfor future predictive modeling or behavior tracking and analysis, sothat future queries may be met with enhanced or refined responses.

Upon initialization, the query system may enter a listening mode whereinput is received through one or more microphones. While input is beingreceived or once query system detects that the query is complete, querysystem 220 may enter a thinking mode where deconstruction of the inputquery is performed using any number of various natural languageprocessing techniques, along with various signal processing andfiltering techniques, known in the art. For example, the query systemmay process a query using a semantic search technique (e.g., naturallanguage processing, machine learning algorithms, fuzzy logic, keywordto concept mapping, etc.). A person of skill in the art would understandhow, for example, keywords or fuzzy keywords may be identified within atext or audible query for further processing. Additionally, someimplementations of query system 220 may use predictive logic todetermine the contents or context of a query. Some implementations canuse a trained deep learning algorithm to, for example, predict thecontents or context of the query.

The context of the query may in some instances correspond to acircumstance of the vehicle or user. For example, based on geographiclocation or GPS information, the context in which the query waspresented may be inferred and the response augmented based on thecontext. In a non-limiting example, a user may desire information onreading an UV index presented within the vehicle. The vehicle maypresent a descriptive content segment for understanding the presentedinformation and may further augment, based on GPS data for example, thedescription by providing UV information for the user's expecteddestination. In some embodiments, the richness of this augmentedinteraction may depend on the number of API connected services that areavailable to a vehicle. Additionally, this type of augmented interactionmay depend on the context-rich metadata included with a particularcontent segment, identified as additional information to displayrelative to an identified vehicle component or control mechanismassociated with the query. For example, if the query is about interiorair quality, the query system may identify that the relevant component(e.g., based on metadata, natural language processing, etc.) correspondsto an indoor air quality sensor. Accordingly, the possible sources ofaugmented content could be, for example, an outside air quality sensor,a cloud-connected weather forecast service, and/or an EnvironmentalProtection Agency (EPA) or Air Resources Board (ARB) website with localinformation on historical or actual pollution patterns in the generalgeographical area. As such, this data may be integrated into a relevantcontent segment or delivered in association with a relevant contentsegment as one or more separate content segments.

Query system 220 may also be configured to differentiate between a queryfor initiating an action within the vehicle, as opposed to onerequesting descriptive information regarding a feature of the vehicle.For example, user queries that query system 220 determines to involvelocation of a feature (e.g., “Where do I adjust,” “Show me thecontrols,” etc.) may trigger retrieval and presentation of the relevantcontrol mechanism associated with the query. In a non-limiting example,the descriptive content segment ordinarily associated with such a querymay not be fetched in response to such a query because the query isbased on the location of a feature and not based on how to perform afunction (e.g., “how do I control,” “show me how to adjust the seat,”etc.). Differentiation between types of queries may further beaccomplished based on keyword detection and semantic analysis, forexample.

In some embodiments, certain types of queries or certain queriesthemselves may be configured to display a descriptive content and therelevant controls. Alternatively, query system 220 may generate andprovide a link (e.g., a floating icon, hyperlinked text, etc.)configured to call the relevant controls or the relevant descriptivecontent when query system 220 only provides one or the other in responseto a query. A user presented with descriptive content segments, forexample, may then select a floating icon or hyperlinked text and bepresented with new content, such as a control screen determinedrelevant, but not pertinent to the user query, based on an initial orsubsequent analysis of the query. For example, query system 220 mayperform a subsequent analysis of the query based on a user selecting ageneric floating control systems icon (e.g., picture of a wrench, etc.)or may provide an individually tailored icon based on the initialanalysis and processing of the query. By waiting to perform a subsequentanalysis, the efficiency of the computer system may be improved, since auser will not always queue the controls through selection of the genericcontrol systems icon. Likewise, a relevant control system interface maybe presented in response to a query, based on specific rules asdescribed herein, with a fixed or floating icon for descriptive contentvia a content segment. Similarly, a user may select the icon or text viathe interactive user interface and be rerouted to a page with onlydescriptive content segments. In some embodiments, the content segmentor segments may be flashed momentarily (e.g., based on a preconfiguredtemporal signal, facial or eye recognition, a voice command indicatingthe control page may be returned, touch or swipe gesture, etc.), asubset or all of the relevant descriptive content segments may bepresented, or a hybrid of content segments and control mechanisms may bedisplayed, as in some instances, would be done in the first instance,for example, when query system 220 deems this linked icon schemeunnecessary based on conditions of the content segments (e.g., metadata,keyword triggers, etc.), query system 220, and the control systemconfiguration, but that both types of content should be displayed. Aperson skilled in the art would understand the various configurationsthat may be achieved with respect to the descriptions herein and thus,for sake of brevity not all combinations are explicitly described.

A trained ML model can be used to process and analyze the user query inaccordance with certain embodiments of this disclosure where ML modelsare considered advantageous (e.g., predictive modeling, inferencedetection, contextual matching, natural language processing, etc.).Examples of ML models that may be used with aspects of this disclosureinclude classifiers and non-classification ML models, artificial neuralnetworks (“NNs”), linear regression models, logistic regression models,decision trees, support vector machines (“SVM”), Naïve or a non-NaïveBayes network, k-nearest neighbors (“KNN”) models, k-means models,clustering models, random forest models, or any combination thereof.These models may be trained based on data indicating how users interactwith query results. For example, certain aspects of the disclosure willbe described using events or behaviors (such as clicking, viewing, orwatching) with respect to items (e.g., vehicle parts, videos, weatherindices, etc.), for purposes of illustration only. In a non-limitingexample, a user may score the results of a user query which may be usedto train an ML model for future queries. This helpful data may be sharedacross a vehicle network so that optimal results may be presented tomore than one user based on similar queries and user reactions to thosequeries. For brevity, these aspects may not be described with respect toevents or behaviors regarding objects (e.g., data objects, such assearch strings).

Vehicle manager 222 can include software and firmware that manages andmonitors vehicle systems, for example by performing diagnostics ofvarious vehicle systems, maintaining vehicle software, and the like.Vehicle manager 222 may also manage interactions between the varioussystems and components of vehicle command center 210. For example,vehicle manager 222 may identify relevant control systems via controlsystem 224 that pair with a query result processed via query system 220.Vehicle manager 222 may also provide relevant vehicle diagnostic data orsensor data to a system configured to generate or retrieve content(e.g., content segments), such as a content management system 226, foraugmenting data presented with a content segment that may be determinedrelevant in response to a user query. For example, a user query may be“how do I read the air quality sensor?” In response to processing anddeconstructing the audible or text-based query, the query system mayidentify a set of relevant content segments comprising vehicleinformation related to the air quality sensor. In addition, the contentsegment may be augmented or enhanced by providing actual data from theair quality sensors along with the relevant descriptive content segment(e.g., a content segment adapted or derived from the vehicle's usermanual or other content source) or with information from an externalsource based on the context of the query (e.g., GPS location of thevehicle and air quality in a current or expected location). For example,identifying the set of relevant content segments may be based on amatching of aspects from the deconstructed query with the context-richmetadata embedded with each content segment. The content segments mayalso be identified through keyword searches in a search engine. A personskilled in the art would understand that various strategies exist forconducting query searches and that any one of those strategies may beimplemented in keeping with the spirit of this disclosure.

In some embodiments, vehicle manager 222 may flash or install vehicleinformation on a vehicle storage device with information from a datanetwork. Additionally, the content stored on the vehicle storage devicemay be updated, modified, or otherwise replaced with data from the datanetwork. For example, a portion or segment of the user manual may bedetermined to be faulty or outdated and thus, may be replaced by a newversion from the data network in a database stored internal or externalto the vehicle but ultimately accessible to a user of the vehicle, asdescribed herein.

In some instances, a set of control mechanisms related to customizing orotherwise manipulating the vehicle's control system may also beidentified, additionally, optionally, or alternatively, in response tothe user query, as further described herein. The control mechanisms maybe identified based on the metadata stored with each content segment orbased on metadata stored with the relevant controls themselves.

Continuing with the previous example, in addition to displaying therelevant content segment and/or relevant control mechanism related toreading and manipulating an air quality sensor, a content segment mayalso be created and formatted to include the actual real-time orhistorical data obtained from the vehicle via one or more of the airquality sensors. In some embodiments, the content segment may bepreconfigured to include a predefined template for including thereal-time data within the predefined template and preconfigured to serveas the basis for an audible read-out response to the query or a visualdisplay of such data. In embodiments where a user query is, for example,“how do I replace my HEPA filter?,” similar information may be providedas before, but additional information may be located and obtainedthrough network 130, such as a tutorial video and/or a parts catalogue,to be presented alongside the vehicle information content segments. Insome embodiments, vehicle manager 222 may receive the query from querysystem 220, determine that the query relates to information notnecessarily stored internally to the vehicle, and thus, leverage asystem application 216, such as a media streaming service, in order tolocate supplemental content through network 130 in order to augment theultimately displayed result. In such embodiments, a user may bepresented with content segment comprising a list of stores nearby thatcarry the relevant part, a how-to video on replacing the part, warrantyinformation on the part, a content segment on how to determine when thepart needs to be replaced as described in the user manual, etc. When thecontent is voluminous, a scroll feature may be presented on the displaydevice, so that a user may scroll through each content segment providedvia interactive user interface. A user may also perform a gesture toremove certain content segments from presentation on the display device(e.g., swiping across the screen, swiping across a touch sensitiveportion of the steering wheel, etc.). In some instances, performing agesture on a content segment may cause the query system to load orpresent a preloaded second content segment that was not included withthe resulting interactive user interface originally presented. A personskilled in the art would understand that other methods of cyclingthrough content may be possible, such as through voice controls, eyemovement, etc. that, for brevity, may not be explicitly described here.

In addition, control system 224 may comprise control mechanisms forcontrolling the vehicle. Control system 224 may also be configured toquery a vehicle control unit, not shown, for data (e.g., raw analog ordigital signals, signals produced by the control unit, etc.) that may beused for augmenting the control segments presented on display system226. In addition, control system 224 may include the user interfacecontrols for controlling certain aspects of the vehicle. For example,control system 224 may manage all input received from a user via a userinterface and present relevant controls based on user input. Inaddition, control system 224 may coordinate with other systems ofvehicle command center 210 to present the controls relevant to the userquery based on the content and context of the query. For example, if auser query is determined to be a query for an action, such as “where doI adjust my steering wheel?,” the control system 224 may provide therelevant controls for adjusting the steering wheel. Alternatively oradditionally, control system 224 may provide an indicator on the displaydevice, such as illuminating and/or animating the relevant controlfeature, or if adjusting the steering wheel is a mechanical function,illuminating the relevant mechanical feature or illuminating a vicinityof the relevant mechanical feature, so that a user may easily identifythe mechanism for adjusting the steering wheel position based on thequery. In a non-limiting example, a user query for opening a vehicledoor may be met with a series of indicator lights within the vehiclepointing towards the car door opener. In addition, the relevantdescriptive content segment may be presented with the relevant controls,which describe operation of the control mechanism in a singleinteractive content segment. Accordingly, a user may dismiss thedescriptive content segment through a preconfigured gesture and thecontrol mechanism may expand to fill the portion of the screenpreviously occupied by the descriptive content segment.

Display system 226 may comprise system software for generating userinterface data based on the content segments to be presented and thedisplay device that is the target of the content segments. The displaydevice 200 may comprise a LCD, LED, OLED, QLED, 4K UHD, plasma, etc.monitor. The display device may be touch-enabled and configured toreceive touch input from a user. Display system 226 may be furtherconfigured to designate a target display device within the vehicle or amobile device associated with the vehicle. Display system 226 mayreceive input from the display devices notifying the display system 226of the size and shape of the display device and may format the userinterface data accordingly. In some instances, a scroll feature may beprovided when the display screen is not sized accordingly to fit allrelevant content. In such instances, a top portion of the user interfacemay be fixed in place such that it does not move when a user scrollsthrough the content. In addition, a cancel feature may also be includedin the user interface, in the fixed portion or elsewhere. Alternatively,a user may cancel the query request or return to a previous page orcontrol screen, using voice commands, touch input, etc.

A person skilled in the art will understand that one or more of thesesystems and components may be implemented separately from vehiclecommand center 210 or may be integrated with other applications andcomponents within command center 210. For example, vehicle manager 222may be integrated with control system 224 in some embodiments.

In addition, FIG. 2 depicts a number of content databases 230 that maybe accessed directly from one or more components of vehicle commandcenter 210 (e.g., content management system 218) through a wired orwireless network 130. Additionally, command signals may be relayed todata server 232, serving as an intermediary or primary system foraccessing, processing, and/or relaying content from content databases230 to or from vehicle command center 210 through network 130. A networkdata interface, not shown, may be included with vehicle command center210 to manage the transfer between the system components, applicationsand network data. A person skill in the art would understand that eachcontent database 230 may be part of a disparate system associated with adedicated data server 232 or have a data server integrated therewith.Furthermore, these servers and databases may be managed or controlled byone or more separate entities (e.g., ISPs, content providers, etc.).

FIG. 3A depicts an example view of an inner cabin of a vehicle (e.g.,operator compartment). In a non-limiting example, the inner cabin of avehicle may include a variety of features and control mechanisms, suchone or more display devices 300, a steering wheel 302, one or moreoperating units 304, and dashboard 306 are explicitly labeled. Forexample, in the example view of FIG. 3, the inner cabin of a vehicle mayinclude a variety of features and control mechanisms, such as one ormore operating units 304 located near the steering wheel 302, on eitherside of steering wheel 302, or located elsewhere away from steeringwheel 302. For example, operating units 304 may include a turn signaloperator, windshield wiper operator, cruise control operator, etc. Insome embodiments, a display device 300 may be located in proximity tothe operator of the vehicle, for example, as shown in FIG. 3. Inaddition, the vehicle may have multiple displays located throughout thevehicle. For example, other display devices, such as display device 300,may be additionally located on the dashboard 306, on a door, or in therear passenger compartment of the vehicle, with similar functionality tothat of display device 300. In some embodiments, each display device maycome equipped with its own dedicated microphone and speaker systemassociated with the individual display device. These multiplemicrophones may be used to triangulate the location of a spoken query,and this triangulation can determine whether the vehicle operator or apassenger is requesting information. In other embodiments, themicrophone or speaker system may be located proximal to a display deviceand yet configured to pair with an individual display device or one ormore dedicated display devices.

In addition, each display device may be tracked, such that query system320 knows which display device is associated with an operator and whichis associated with a non-operator (e.g., passenger) of the vehicle. Forexample, a display device located in a portion of the vehicle associatedwith a passenger, such as in a front passenger seat, rear seat, or elseotherwise located away from an operator, may be recognized as a devicenot associated with the operator and thus, when a query is recognized ascoming from the non-operator device, the system may behave differentlythan if the query is recognized as coming from an operator device, asdescribed.

A person skilled in the art would understand that the configuration of avehicle may differ from that shown in FIG. 3 and that this is merely anexample to illustrate certain embodiments of the disclosed technology.In addition, the operator compartment of other types of vehicles may beconfigured differently. For example, the operator compartment of anairplane, boat, farming vehicle, etc. may include different controlmechanisms and display devices nonetheless configured to operate inaccordance with the disclosed technology.

FIG. 3B depicts an example interactive user interface 320 configured todisplay on a display device, such as display device 300. In the exampleof FIG. 3B, the query system 220 has been initiated and has entered intolistening mode. A person skilled in the art would understand that a usermay be notified that a system is in listening mode in other ways,including animations, illuminating lights, audible indicators, orotherwise with a message on the screen, as shown. The user query in theexample of FIG. 3B is “how often should I replace my HEPA filter?” Asthe user provides the query, query system 220 may process the query andpresent text on the screen as the query is being provided or once thequery is complete. The interactive user interface 320 may include othercontent, such as default control features on the screen (e.g., music,climate control, etc.), not explicitly shown in FIG. 3B.

FIG. 3C depicts an example interactive user interface showing a controlscreen 350. This user interface may be presented on a display device inresponse to a user query. Alternatively, in response to a user query, auser may be presented with an option (not shown) to, for example,navigate to a control screen 350 comprising control features deemedrelevant to the query, access content segments determined relevant tothe user query, or access vehicle documentation (e.g., user manual,warranty manual) based on the query. In a non-limiting example, a usermay select, via the interactive user interface, to navigate to controlscreen 350. Control screen 350 may include control features 355, such asa series of soft keys (e.g., knobs, buttons, switches, etc.) that areconfigured to control features of the vehicle. In a non-limitingexample, the control screen 350 may present climate controls foradjusting the temperature including controls for increasing ordecreasing the temperature, controls for adjusting fan speed, etc. Thecontrol features may be identified based on the results of the naturallanguage processing. In some embodiments, varying degrees of controlfeatures may be presented on different display devices and may havevarying degrees of control associated with said features. For example, adisplay device associated with an operator of the vehicle may havefunctionality to control all windows of the vehicle, whereas a displaydevice associated with a passenger may only be presented with controlsto control a respective window of the vehicle. These control privilegesmay be customizable by a person with appropriate customizationprivileges. For example, the owners or primary operators of a vehiclemay be able to customize all privileges from a mobile device or from aninterface located within the vehicle (e.g., based on access privilegesbestowed on the owners at the time of purchase).

In addition, one or more icons 360 may be presented that, if selected,would route the user to one of the other options previously presented.The icon 360 may be a floating icon (e.g., moveable on the screen by auser) or fixed in place on the screen. Selecting icon 360 may be one ofmany ways a user may access content segments, similar to those shown inFIG. 3D.

FIG. 3D depicts an example interactive user interface 370. The exampleinteractive user interface 370 may be displayed on a display device 300as shown, in response to a user query (e.g., the user query of FIG. 3B).Interactive user interface 370 may include a plurality of contentsegments 372, 374, 376, 378 which represent example content segmentsidentified by vehicle command center 210 based on metadata associatedwith content segments stored within a vehicle storage device or contentidentified external to the vehicle storage device, such as related links374, related content 376, related queries 378, etc. In a non-limitingexample, the primary content segment result 372 may be shown at the topof the screen. In some instances, a portion of the screen may be fixed,such that scrolling on the screen would restrict that portion of thescreen from changing. For example, display device 300 may fix a topheader, a primary content segment, or the most relevant contentsegments, from moving as a user manipulates other content on the displaydevice. Query system 220 may determine the relevance of each contentsegment based on how and from where the query is invocated (e.g.,certain content segments may be more relevant to an operator than apassenger providing the same or similar query), how much context isembedded within each content segment, and/or a structured weighting ofcertain elements of a content segment or within elements comprising themetadata of a content segment. The content segments and control featurescomprise as much data as possible to account for a variety of possibleinvocation methods an end user might employ. Accordingly, query system220 may be able to parse through the structured datasets quickly andaccurately to provide a user with the most relevant and enriched contentavailable to enhance the user experience with the vehicle system and toallow the user to quickly navigate a vehicle that may be foreign to theminitially.

In some embodiments, query system 220 may identify content segmentsbased on relevancy to one or more user queries. In a non-limitingexample, if the user queries “How do I adjust my steering wheel,” thenquery system 220 can start, based on its programming, by finding theobject in the sentence (i.e., “steering wheel”). Next, query system 220may search for metadata that matches that object. If multiple items orcontent segments have metadata matching “steering wheel,” then otherwords in the query can be used to narrow the selection, such as“adjust,” or other words in queries stored in memory may be used forfurther context.

In some embodiments, content segment 372 may contain informationparticular to the user, such as augmented details regarding the user'sgeographic location, user settings or preferences, or other context ofthe query. In some instances, the augmented data may be presented as aseparate content segment with the primary content segment containingstatic content unaltered based on the context of the user query.

In other embodiments, a descriptive content segment 372 may be presentedalong with a relevant control system feature on the display screen (notshown). In such embodiments, a user may manipulate the controls, as wellas receive the descriptive content for the controls, via interactiveuser interface 370. For example, a content segment may include anembedded link (e.g., a selectable navigational feature) to a relevantcontrol feature. In a non-limiting example, the embedded link may beincluded as part of the metadata associated with a content segment.Additionally, the embedded link may be programmed to exist as thecontent segment itself or as an invisible link hidden within the contentsegment, such that when a user selects the content segment within theconfines of the segment, the link is activated. In response toactivating the link, the linked control feature may be presented on theuser interface. A user may revert to the previous screen by initiatinganother command (e.g., cancel, back, etc.). In some instances, thelinked control feature may automatically be removed from presentation onthe interactive user interface after a predetermined amount of timepasses without a user interacting with the presented control feature.

In some instances, vehicle command center 210 may be configured to calla language translation API via network 130 to perform a machinetranslation on the results before presenting the results on a displaydevice based on a language of the user. The same may also be done when auser inputs a query in a language foreign to operating mechanisms withinthe vehicle.

In addition, interactive user interface 370 may include related links374 which a user may select in order to be rerouted to receive contentassociated with the link. The related links may be determined based onmetadata associated with the content segments and the deconstruction ofthe user query. For example, related links may include links to contentsegments internally stored in the vehicle, current state of health basedon diagnostic or performance data of the vehicle or may include contentexternal to the vehicle (e.g., automatic re-ordering settings, etc.). Inanother example, a selected link may be configured to display data on amobile device linked to the vehicle. For example, a user may selected“HEPA Filter Illustrated Replacement Procedure (Mobile App)” which maythen launch an application on the user's mobile device illustrating sucha procedure. In some embodiments, the mobile application may utilizeaugmented reality technology to guide a user in replacing the part atissue. Additionally, related queries 378 may be displayed allowing auser to select the related query via touch input to receive informationbased on the related query.

In a non-limiting example, related content 376 may be presented showingan informational video 377 (with a play button) that was obtained vianetwork 130 determined to be relevant to the search results.Alternatively, informational video 377 may have been located internallyto the vehicle. In some embodiments, command center 210 may identifyrelated content 376 via network 130 by either submitting thedeconstructed query directly to a network search engine or may firstdetermine what internal content is identified based on the user queryand based on the results and metadata associated with the results,determine whether a search query should still be submitted via network130. In some instances, related content 376 is unnecessary and programinstructions may be implemented accordingly. For example, a trigger maybe included in the content metadata that signals that a network searchshould be conducted for related content. In other instances, a machinelearning or deep learning algorithm may determine based on evolving userpreferences known to the system whether the user would benefit fromrelated content 376 from network 130 due to historical and/orstatistical data associated with the user (e.g., number of video viewsof related content, number of times the user dismisses the contentsegment or removes it from the viewing display, etc.).

FIG. 3E depicts an example interactive user interface 380 showing anexample menu of options for user selection. A menu or index of this typemay be displayed in certain embodiments where a user selects a usermanual icon or option or may be displayed directly as a result of aquery. In some embodiments, each indexed option in the menu may providea full listing of content segments, a limited listing of contentsegments, or all content segments available regardless of whether theyare considered relevant to a query. In a non-limiting example, a usermay be transitioned to a user interface similar to user interface 380when a user selects an option for accessing the on-board user manual.This option may be presented alongside an option to access a controlscreen, as shown in FIG. 3F. As shown in the example embodiment of FIG.3F, query system 220 may also generate display data based on video,image, animated image, or other visual or audio data relevant to thespecific query for display in user interface 390. In a non-limitingexample, this data may be displayed as a preview of content availablethrough either the user manual tab or control screen tab based on thequery. Selection of either option may direct the user to the relevantportion of the user manual, the relevant portion of the control screenor a hybrid of both, with content segments displayed in any situation,as described herein.

FIG. 4 depicts a flow chart illustrating an example logical flow of aprocess 455 for generating and delivering query results in a connectedvehicle, according to certain embodiments described herein. The process455 can be implemented at least partly by the query system 220 of FIG.2.

At block 400, the query system 220 receives the user query. A user querymay be received via a microphone in the vehicle, on a mobile device orthrough a text-based entry. In addition, a display device may beidentified as associated with the query. For example, if a user in apassenger seat initiates the query from a display device on thepassenger side of the vehicle (e.g., not associated with the driver oroperator), then the system may identify the query as being associatedwith a passenger rather than the operator of the vehicle. Based on theorigin of the query, the number of control features may be suppressedthat would otherwise be displayed for other users, such as an operator.For example, a query associated with the driver of a vehicle may resultin the display of more control features available on the display screen,than would be available if the query is associated with a passenger.

At block 410, the query system 220 processes and deconstructs the userquery to identify keywords, fuzzy keywords, logical patterns, sounds,phrases, etc. In some embodiments, the user query may be recorded byquery system 220 and saved in a memory storage device associated withthe vehicle. For example, a user query may be related to a sound thevehicle is emitting and thus, the sound may be recorded for use indiagnosing whether the sound is abnormal. At block 420, contentdatabases may be searched based on the user query, including a searchthrough metadata associated with the content. At block 430, relevantcontent and related content may be identified based on the searchresults. The relevant content may be prioritized or scored based ondegree of relevancy to the query such that the best result may bepresented directly to the user, whereas tangentially related content,for example, may be presented as related content. In some embodiments,the content segment with the highest number of matching metadata hitscould determine relevancy. In the case where the content identifiedinternally does not exceed a predetermined relevancy threshold, thequery system may resort to identifying a content segment over network130 that is at least tangentially related for presentation. In addition,the system may indicate that the content was identified may notnecessarily be relevant and that the user may need to perform a morerefined query. A person skilled in the art would understand that variousrules may be employed for determining relevancy based on a voice or textquery and that for sake of brevity, not all rules or combination ofrules may be explicitly described herein.

At block 440, the query system 220 can augment the content segmentsbased on information specific to the vehicle, user, or context of thequery (e.g., geographic location, GPS data, maintenance logs, etc.). Forexample, query system 220 may determine a link a content segment may beaugmented by including a link (e.g., a hashtag, hyperlink) to additionalcontent relevant to the user query. The content segments may beformatted to be displayed on one or more display devices. At block 450,the query system 220 can generate interactive or graphical userinterface data based on the content segments. The user interface may bedisplayed on a display device associated with a query (e.g., display300) or on other display devices depending on the context and content ofthe query and the user associated with the query. A display device maybe associated with a query when the query activation is initiated fromthe display device, input is received through an interface on a specificdisplay device, or based on which display device is closest to the usermaking the query. For example, a passenger may cause the display devicelocated closest to the operator to enter listening mode by pressing anactivation soft key located on that display device. The passenger maymake the query from the passenger side of the vehicle. The system maypreviously store who the operator and/or passengers of the vehicle arebased on facial recognition, voice recognition, or triangulationmethods. The query system 220 may receive a signal that, although theoperator display device was activated, the query is being made by apassenger. Accordingly, the results of the query may be displayed on adisplay device associated with the passenger (e.g., passenger doorpanel, mobile device, etc.). In addition, the results of the query maybe read aloud according to safety rules, as described herein (e.g.,vehicle speed considerations, etc.). In another example, a queryassociated with an operator initiated from an operator display device(or as recognized through facial or voice recognition) may result insearch results being presented on a passenger side display device, aswell as the operator display device or in lieu of presenting results onthe operator display device when the vehicle is currently being operated(e.g., above a certain threshold speed).

In a non-limiting example, the results of a query made by a driver maynot be presented on a display device if the vehicle is determined to betraveling above a threshold speed, for a certain amount of time, and/orwith an acceleration rate above a certain threshold. For example, theresults of a query may not be displayed on a screen associated with(e.g., proximate to and/or visible to) the operator until the vehicledecreases to a speed below 2.5 miles per hour for more than 30 seconds.Accordingly, the system may read aloud through the vehicle's speakerscertain limited results of the search (e.g., a primary content segment).In some instances, the vehicle system may be in an autonomous operatingmode, in which case the content may be displayed to an operator as itwould be less distracting than if the operator were actively controllingthe vehicle.

In various implementations, the described blocks of the flowchart ofFIG. 4 may be performed in an order other than that specificallydisclosed, or multiple blocks may be combined in a single block. Theexample blocks may be performed in serial, in parallel, or in some othermanner. Further, blocks may be added to or removed from the disclosedexample embodiments.

Execution Environment

FIG. 5 is a block diagram that illustrates a computer system 500 uponwhich various embodiments may be implemented. Computer system 500includes a bus 502 or other communication mechanism for communicatinginformation, and a hardware processor, or multiple processors, 504coupled with bus 502 for processing information. Hardware processor(s)504 may be, for example, one or more general purpose microprocessors.

Computer system 500 also includes a main memory 506, such as a randomaccess memory (RAM), cache and/or other dynamic storage devices, coupledto bus 502 for storing information and instructions to be executed byprocessor 504. Main memory 506 also may be used for storing temporaryvariables or other intermediate information during execution ofinstructions to be executed by processor 504. Such instructions, whenstored in storage media accessible to processor 504, render computersystem 500 into a special-purpose machine that is customized to performthe operations specified in the instructions. In some embodiments, thevehicle command center 210 or one or more components of vehicle commandcenter 210 may be implemented within computer system 500.

Computer system 500 further includes a read only memory (ROM) 508 orother static storage device coupled to bus 502 for storing staticinformation and instructions for processor 504. A storage device 510,such as a magnetic disk, solid-state drive, optical disk, or USB thumbdrive (Flash drive), etc., is provided and coupled to bus 502 forstoring information and instructions.

Computer system 500 may be coupled via bus 502 to a display 512, such asa cathode ray tube (CRT) or LCD display (or touch screen), fordisplaying information to a user. An input device 514, includingmicrophones and alphanumeric or other keys, may be coupled to bus 502for communicating information and command selections to processor 504.Another type of user input device is cursor control 516, such as amouse, a trackball, or cursor direction keys for communicating directioninformation and command selections to processor 504 and for controllingcursor movement on display 512. This input device typically has twodegrees of freedom in two axes, a first axis (e.g., x) and a second axis(e.g., y), that allows the device to specify positions in a plane. Insome embodiments, the same direction information and command selectionsas cursor control may be implemented via receiving touches on a touchscreen without a cursor.

Computing system 500 may include a user interface module to implement aGUI that may be stored in a mass storage device as computer executableprogram instructions that are executed by the computing device(s).Computer system 500 may further, as described below, implement thetechniques described herein using customized hard-wired logic, one ormore ASICs or FPGAs, firmware and/or program logic which in combinationwith the computer system causes or programs computer system 500 to be aspecial-purpose machine. According to one embodiment, the techniquesherein are performed by computer system 500 in response to processor(s)504 executing one or more sequences of one or more computer readableprogram instructions contained in main memory 506. Such instructions maybe read into main memory 506 from another storage medium, such asstorage device 510. Execution of the sequences of instructions containedin main memory 506 causes processor(s) 504 to perform the process stepsdescribed herein. In alternative embodiments, hard-wired circuitry maybe used in place of or in combination with software instructions.

Various forms of computer readable storage media may be involved incarrying one or more sequences of one or more computer readable programinstructions to processor 504 for execution. For example, theinstructions may initially be carried on a magnetic disk or solid-statedrive of a remote computer. The remote computer can load theinstructions into its dynamic memory and send the instructions over atelephone line using a modem. A modem local to computer system 500 canreceive the data on the telephone line and use an infra-red transmitterto convert the data to an infra-red signal. An infra-red detector canreceive the data carried in the infra-red signal and appropriatecircuitry can place the data on bus 502. Bus 502 carries the data tomain memory 506, from which processor 504 retrieves and executes theinstructions. The instructions received by main memory 506 mayoptionally be stored on storage device 510 either before or afterexecution by processor 504.

As used herein, the term “remote” does not necessarily mean that twodevices must be in different physical or geographic locations. Rather,remote devices include devices that communicate via a networkconnection, such as the Internet or a local area network (“LAN”), ratherthan devices that are directly connected via a wired or wirelessconnection. While devices in different physical or geographic locationsmay be remote devices, devices in the same location (e.g., a singleroom) and devices physically operated by the same user may also beremote devices.

Computer system 500 also includes a communication interface 518 coupledto bus 502. Communication interface 518 provides a two-way datacommunication coupling to a network link 520 that is connected to alocal network 522. For example, communication interface 518 may be anintegrated services digital network (ISDN) card, cable modem, satellitemodem, or a modem to provide a data communication connection to acorresponding type of telephone line. As another example, communicationinterface 518 may be a local area network (LAN) card to provide a datacommunication connection to a compatible LAN (or WAN component tocommunicate with a WAN). Wireless links may also be implemented. In anysuch implementation, communication interface 518 sends and receiveselectrical, electromagnetic or optical signals that carry digital datastreams representing various types of information.

Network link 520 typically provides data communication through one ormore networks to other data devices. For example, network link 520 mayprovide a connection through local network 522 to a host computer 524 orto data equipment operated by an Internet Service Provider (ISP) 526.ISP 526 in turn provides data communication services through theworld-wide packet data communication network now commonly referred to asthe “Internet” 528. Local network 522 and Internet 528 both useelectrical, electromagnetic or optical signals that carry digital datastreams. The signals through the various networks and the signals onnetwork link 520 and through communication interface 518, which carrythe digital data to and from computer system 500, are example forms oftransmission media.

Computer system 500 can send messages and receive data, includingprogram code, through the network(s), network link 520 and communicationinterface 518. In the Internet example, a server 530 might transmit arequested code for an application program through Internet 528, ISP 526,local network 522 and communication interface 518. The received code maybe executed by processor 504 as it is received, and/or stored in storagedevice 510, or other non-volatile storage for later execution.

Terminology

All of the methods and tasks described herein may be performed and fullyautomated by a computer system. The computer system may, in some cases,include multiple distinct computers or computing devices (e.g., physicalservers, workstations, storage arrays, cloud computing resources, etc.)that communicate and interoperate over a network to perform thedescribed functions. Each such computing device typically includes aprocessor (or multiple processors) that executes program instructions ormodules stored in a memory or other non-transitory computer-readablestorage medium or device (e.g., solid state storage devices, diskdrives, etc.). The various functions disclosed herein may be embodied insuch program instructions, or may be implemented in application-specificcircuitry (e.g., ASICs or FPGAs) of the computer system. Where thecomputer system includes multiple computing devices, these devices may,but need not, be co-located. The results of the disclosed methods andtasks may be persistently stored by transforming physical storagedevices, such as solid-state memory chips or magnetic disks, into adifferent state. In some embodiments, the computer system may be acloud-based computing system whose processing resources are shared bymultiple distinct business entities or other users.

The disclosed processes may begin in response to an event, such as on apredetermined or dynamically determined schedule, on demand wheninitiated by a user or system administer, or in response to some otherevent. When the process is initiated, a set of executable programinstructions stored on one or more non-transitory computer-readablemedia (e.g., hard drive, flash memory, removable media, etc.) may beloaded into memory (e.g., RAM) of a server or other computing device.The executable instructions may then be executed by a hardware-basedcomputer processor of the computing device. In some embodiments, theprocess or portions thereof may be implemented on multiple computingdevices and/or multiple processors, serially or in parallel.

Depending on the embodiment, certain acts, events, or functions of anyof the processes or algorithms described herein can be performed in adifferent sequence, can be added, merged, or left out altogether (e.g.,not all described operations or events are necessary for the practice ofthe algorithm). Moreover, in certain embodiments, operations or eventscan be performed concurrently, e.g., through multi-threaded processing,interrupt processing, or multiple processors or processor cores or onother parallel architectures, rather than sequentially.

The various illustrative logical blocks, modules, routines, andalgorithm steps described in connection with the embodiments disclosedherein can be implemented as electronic hardware (e.g., ASICs or FPGAdevices), computer software that runs on computer hardware, orcombinations of both. Moreover, the various illustrative logical blocksand modules described in connection with the embodiments disclosedherein can be implemented or performed by a machine, such as a processordevice, a digital signal processor (“DSP”), an application specificintegrated circuit (“ASIC”), a field programmable gate array (“FPGA”) orother programmable logic device, discrete gate or transistor logic,discrete hardware components, or any combination thereof designed toperform the functions described herein. A processor device can be amicroprocessor, but in the alternative, the processor device can be acontroller, microcontroller, or state machine, combinations of the same,or the like. A processor device can include electrical circuitryconfigured to process computer-executable instructions. In anotherembodiment, a processor device includes an FPGA or other programmabledevice that performs logic operations without processingcomputer-executable instructions. A processor device can also beimplemented as a combination of computing devices, e.g., a combinationof a DSP and a microprocessor, a plurality of microprocessors, one ormore microprocessors in conjunction with a DSP core, or any other suchconfiguration. Although described herein primarily with respect todigital technology, a processor device may also include primarily analogcomponents. For example, some or all of the rendering techniquesdescribed herein may be implemented in analog circuitry or mixed analogand digital circuitry. A computing environment can include any type ofcomputer system, including, but not limited to, a computer system basedon a microprocessor, a mainframe computer, a digital signal processor, aportable computing device, a device controller, or a computationalengine within an appliance, to name a few.

The elements of a method, process, routine, or algorithm described inconnection with the embodiments disclosed herein can be embodieddirectly in hardware, in a software module executed by a processordevice, or in a combination of the two. A software module can reside inRAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory,registers, hard disk, a removable disk, a CD-ROM, or any other form of anon-transitory computer-readable storage medium. An exemplary storagemedium can be coupled to the processor device such that the processordevice can read information from, and write information to, the storagemedium. In the alternative, the storage medium can be integral to theprocessor device. The processor device and the storage medium can residein an ASIC. The ASIC can reside in a user terminal. In the alternative,the processor device and the storage medium can reside as discretecomponents in a user terminal.

Any of the above-mentioned processors, and/or devices incorporating anyof the above-mentioned processors, may be referred to herein as, forexample, “computers,” “computer devices,” “computing devices,” “hardwarecomputing devices,” “hardware processors,” “processing units,” and/orthe like. Computing devices of the above-embodiments may generally (butnot necessarily) be controlled and/or coordinated by operating systemsoftware, such as Mac OS, iOS, Android, Chrome OS, Windows OS (e.g.,Windows XP, Windows Vista, Windows 7, Windows 8, Windows 10, WindowsServer, etc.), Windows CE, Unix, Linux, SunOS, Solaris, Blackberry OS,VxWorks, or other suitable operating systems. In other embodiments, thecomputing devices may be controlled by a proprietary operating system.Conventional operating systems control and schedule computer processesfor execution, perform memory management, provide file system,networking, I/O services, and provide a user interface functionality,such as a graphical user interface (“GUI”), among other things.

Conditional language used herein, such as, among others, “can,” “could,”“might,” “may,” “e.g.,” and the like, unless specifically statedotherwise, or otherwise understood within the context as used, isgenerally intended to convey that certain embodiments include, whileother embodiments do not include, certain features, elements or steps.Thus, such conditional language is not generally intended to imply thatfeatures, elements or steps are in any way required for one or moreembodiments or that one or more embodiments necessarily include logicfor deciding, with or without other input or prompting, whether thesefeatures, elements or steps are included or are to be performed in anyparticular embodiment. The terms “comprising,” “including,” “having,”and the like are synonymous and are used inclusively, in an open-endedfashion, and do not exclude additional elements, features, acts,operations, and so forth. Also, the term “or” is used in its inclusivesense (and not in its exclusive sense) so that when used, for example,to connect a list of elements, the term “or” means one, some, or all ofthe elements in the list.

Disjunctive language such as the phrase “at least one of X, Y, or Z,”unless specifically stated otherwise, is otherwise understood with thecontext as used in general to present that an item, term, etc., may beeither X, Y, or Z, or any combination thereof (e.g., X, Y, or Z). Thus,such disjunctive language is not generally intended to, and should not,imply that certain embodiments require at least one of X, at least oneof Y, and at least one of Z to each be present.

While the above detailed description has shown, described, and pointedout novel features as applied to various embodiments, it can beunderstood that various omissions, substitutions, and changes in theform and details of the devices or algorithms illustrated can be madewithout departing from the scope of the disclosure. As can berecognized, certain embodiments described herein can be embodied withina form that does not provide all of the features and benefits set forthherein, as some features can be used or practiced separately fromothers. All changes which come within the meaning and range ofequivalency of the claims are to be embraced within their scope.

What is claimed is:
 1. A system for accessing content for a vehicle, thesystem comprising: a database storing vehicle operational contentformatted as a plurality of segmented portions each associated with aset of contextual metadata; a computer-readable memory storingexecutable instructions; and at least a processor in communication withthe computer-readable memory and programmed by the executableinstructions to at least: receive, over at least one network, updates toindividual segmented portions of the plurality of segmented portionsincluding at least an update to a particular segmented portion; receivedata representing a query spoken by a user; perform natural languageprocessing on the data representing the query; determine that the queryincludes a request for a portion of the vehicle operational contentbased at least in part on a result of the natural language processing;identify the particular segmented portion of the plurality of segmentedportions based at least in part on the set of contextual metadata of theparticular segmented portion and the result of the natural languageprocessing; generate a user interface for presenting the particularsegmented portion on a display associated with the vehicle, wherein theuser interface is generated to reflect the update to the particularsegmented portion; determine a driving status of one or both of thevehicle and the user; and when the driving status indicates that it issafe for the user to view information on the display, cause output ofthe user interface on the display, or when the driving status indicatesthat it is not safe for the user to view information on the display,store data representing the user interface for later output on thedisplay.
 2. The system of claim 1, wherein the processor is furtherconfigured to: store a version of the particular segmented portioncorresponding to a version of a user manual of the vehicle that isavailable at a time of storing the version.
 3. The system of claim 1,wherein the processor is further configured to determine the drivingstatus is in motion in response to determining that the vehicle is inmotion above a predetermined threshold, and wherein the in-motiondriving status indicates that it is not safe for the user to viewinformation on the display.
 4. The system of claim 1, wherein theprocessor is further configured to: determine whether the queryoriginates from an operator of the vehicle; and in response todetermining the query originates from the operator, cause output of anaudible reading of the particular segmented portion through a speaker.5. The system of claim 1, wherein the display is in a field of view ofan operator of the vehicle.
 6. The system of claim 1, wherein theprocessor is further configured to: determine a set of vehicle controlsrelevant to the query; and generate the user interface to includenavigational links to the vehicle controls.
 7. The system of claim 6,wherein the processor is further configured to generate the userinterface to include an animation of instructions included with the setof vehicle controls to animate the relevant set of vehicle controls. 8.The system of claim 1, wherein the processor is further configured to:receive contextual content from at least one remote data source toaugment the particular segmented portion; and present the contextualcontent as part of the user interface.
 9. A computer-implemented method,comprising: storing a version of vehicle operational content, thevehicle operational content formatted as a plurality of segmentedportions each associated with contextual metadata; receiving, over atleast one network, an update to the vehicle operational contentincluding at least an update to a particular segmented portion of theplurality of segmented portions; receiving data representing a queryspoken by a user; performing natural language processing on the datarepresenting the query; determining that the query includes a requestfor a portion of the vehicle operational content based at least in parton a result of the natural language processing; identifying theparticular segmented portion of the plurality of segmented portionsbased at least in part on the set of contextual metadata of theparticular segmented portion and the result of the natural languageprocessing; generating a user interface for presenting the particularsegmented portion on a display associated with the vehicle, wherein theuser interface is generated to reflect the update to the particularsegmented portion; determining a driving status of one or both of thevehicle and the user; and when the driving status indicates that it issafe for the user to view information on the display, cause output ofthe user interface on the display, or when the driving status indicatesthat it is not safe for the user to view information on the display,store data representing the user interface for later output on thedisplay.
 10. The computer-implemented method of claim 9, wherein theversion of vehicle operational content corresponds to a version of auser manual of the vehicle that is available at a time of storing theversion.
 11. The computer-implemented method of claim 9, furthercomprising determining that the driving status is in motion in responseto determining that the vehicle is in motion above a predeterminedthreshold, wherein the in-motion driving status indicates that it is notsafe for the user to view information on the display.
 12. Thecomputer-implemented method of claim 9, further comprising: determiningwhether the query originates from an operator of the vehicle; and inresponse to determining the query originates from the operator, causingoutput of an audible reading of the particular segmented portion througha speaker.
 13. The computer-implemented method of claim 9, wherein thedisplay is in a field of view of an operator of the vehicle.
 14. Thecomputer-implemented method of claim 9, further comprising: determininga set of vehicle controls relevant to the query; and generating the userinterface to include navigational links to the vehicle controls.
 15. Thecomputer-implemented method of claim 14, further comprising generatingthe user interface to include an animation of instructions included withthe set of vehicle controls to animate the relevant set of vehiclecontrols.
 16. The computer-implemented method of claim 9, furthercomprising: receiving contextual content from at least one remote datasource to augment the particular segmented portion; and presenting thecontextual content as part of the user interface.
 17. A non-transitory,computer-readable medium having stored thereon computer-executablesoftware instructions configured to cause a processor of a computingdevice to perform operations comprising: storing a version of vehicleoperational content, the vehicle operational content formatted as aplurality of segmented portions each associated with contextualmetadata; receiving, over at least one network, an update to the vehicleoperational content including at least an update to a particularsegmented portion of the plurality of segmented portions; receiving datarepresenting a query spoken by a user; performing natural languageprocessing on the data representing the query; determining that thequery includes a request for a portion of the vehicle operationalcontent based at least in part on a result of the natural languageprocessing; identifying the particular segmented portion of theplurality of segmented portions based at least in part on the set ofcontextual metadata of the particular segmented portion and the resultof the natural language processing; generating a user interface forpresenting the particular segmented portion on a display associated withthe vehicle, wherein the user interface is generated to reflect theupdate to the particular segmented portion; determining a driving statusof one or both of the vehicle and the user; and when the driving statusindicates that it is safe for the user to view information on thedisplay, cause output of the user interface on the display, or when thedriving status indicates that it is not safe for the user to viewinformation on the display, store data representing the user interfacefor later output on the display.
 18. The non-transitory,computer-readable medium of claim 17, wherein determining the drivingstatus of the user comprises determining an origination point for thequery.
 19. The non-transitory, computer-readable medium of claim 17,wherein the vehicle content comprises a plurality of interactive contentsegments, including the first segmented portion, and wherein theplurality of interactive content segments comprises discretely packagedinformation.
 20. The non-transitory, computer-readable medium of claim17, wherein the operations further comprise: receiving contextualcontent from at least one remote data source to augment the particularsegmented portion; and presenting the contextual content as part of theuser interface.